14:00
2026-07-14
lesswrong.com
artificial-intelligence
Enough is Enough: Measuring Diminishing returns to benchmark size with Item Response Theory
A researcher applied Item Response Theory to measure diminishing returns from increasing LLM benchmark size, using Omni-MATH as a case study. The analysis shows that adding more questions yields less …